Systems and methods for dynamic content restriction based on a relationship

ABSTRACT

Systems and methods are provided herein to dynamically update content restrictions for multiple users by detecting a first user in the proximity of a media device playing a first content item and detecting a second user entering the proximity of the media device. In response to detecting a second user entering the proximity of the media device and receiving a command from the first user that controls playing the first content, the system modifies a stored relationship between the first user and the second user to track the relationship between the first user and the second user. Thereafter, when the system detects the first user and the second user in the proximity of a media device playing a second content, in response, the system automatically performs an action that controls the playing of the second content (e.g., without user having to issue those commands).

BACKGROUND

The present disclosure generally relates to systems and methods forproviding dynamic content restrictions based on relationships and, moreparticularly, systems and methods for developing a database of contentrestrictions based on a relationship between multiple users.

SUMMARY

In one approach, parental control systems are designed on a per-userbasis. That is, a parental control system may be configured to allow orprohibit display of content based on the setting for each individualuser. In another approach, when multiple users are present, the systemwill simply use the setting associated with the most restricted user.For example, if an adult and a child are present, the system may simplydefault to using the parental control setting associated with the child.This approach prevents content from being presented to a user, for whompresentation of the content would violate the user's authorization levelsettings; however, this approach does not account for relationshipbetween the users. For example, two users may both be individuallyauthorized to view certain content on their own but may not becomfortable consuming (e.g., watching) that content together (e.g., ateen may be uncomfortable watching suggestive content with hisgrandmother).

A system described above would not account for this and would allow suchcontent to be played, since a parental control policy is not violatedfor each individual user. Accordingly, the content enjoyment of otherusers in the room is negatively impacted. Worse, a user in such asituation may issue control actions (e.g., switching channel, loweringthe volume), causing unnecessary functions to be performed anddecreasing system performance when playing a media asset.

Accordingly, to solve this problem, methods and systems are provided todynamically update content restrictions based on a relationship ofmultiple users. In some embodiments, methods and systems are provided todynamically update content restrictions for multiple users by detectinga first user in the proximity of a media device playing the firstcontent. For example, a first user is watching a movie (e.g., “BasicInstinct”) with an “R” rating based on the rating system of the MotionPicture Association of America, with sexually oriented nudity. As thefirst user is viewing the first movie, a second user (e.g., sister,mother, grandfather, coworker, etc.) enters the proximity of the mediadevice playing the first content. Upon the second user entering theroom, the system receives a command from the first user that controlsplaying the first content (“Basic Instinct”). In some embodiments, thecommand that controls playing the first content may be muting a volumeof the media device playing the first content, lowering the volume ofthe media device playing the first content, or changing a channel of themedia device playing the first content. Based on the received command,the system then modifies a stored relationship between the first userand the second user to track the relationship between the first user andthe second user. For example, the system modifies the storedrelationship with the data related to the command performed and whatcontent the first user was viewing. In some embodiments, when the systemsubsequently detects the first user and the second user in the proximityof the media device playing a second content item, in response, thesystem automatically performs an action that controls the playing of thesecond content item (e.g., without a user having to issue the command).In some embodiments, the action may correspond to the command receivedbefore, from the first user, or it may be another action. In someembodiments, the system selects the action based on the storedrelationship status that tracks the relationship between the first userand the second user. This avoids unnecessary functions to be performedby the user, thereby improving content enjoyment of all users in theroom by performing the control actions automatically, based on users'relationships and not merely based on individuals' settings.

In some embodiments, the system may perform the action that controls theplaying of the second content item by automatically performing the samecommand that was used previously (i.e., without a user having to issuethe command). For example, the received command and the automatic actionperformed by the system may be the same action, one that is selectedfrom muting a volume of the media device playing the first content,lowering the volume of the media device playing the first content, andchanging a channel of the media device playing the first content thatthe first user entered. In some embodiments, the system may perform theaction that controls the playing of the second content item byautomatically performing a different command than was used previously.For example, the system may insert an advertisement into thepresentation of the second content item. In some embodiments, the systemmay perform a different command, for example, it may play a version ofthe second content item that is one authorization level below thecurrent authorization. For example, while playing the R-rated version ofa movie, the system may search and replace the R-rated version with aPG-13 rated version upon the second user entering the proximity of thedevice. In another embodiment, the system may detect that the seconduser is no longer in the proximity of the device.

In some embodiments, the system may perform the action without receivingthe command from the first user to perform the command. For example, inresponse to the second user entering the proximity of the media device,the system performs the action without receiving the command from thefirst user to perform the command. An aspect of this embodiment, thesystem does not perform the action when only one of the users is in theproximity of the media device. For example, the action that controls theplaying of the second content item is not performed when just one userof the first user and the second user is in the proximity of the mediadevice but is performed when both the first user and the second user aredetected in the proximity of the media device.

In some embodiments, the system may modify the stored relationshipstatus between the first user and the second user by retrieving existingrelationship data between the first user and the second user based on afirst user profile associated with the first user and a second userprofile associated with the second user. In an aspect of thisembodiment, the existing relationship data may be obtained from anexisting parental control. In another aspect of this embodiment, therespective user profile data may be obtained from a social mediadatabase (e.g., Facebook®, Twitter®, etc.). For example, the system maycreate a combined profile that includes both users (e.g., first user andsecond user) and indicates the restriction level based on ratings andthe control actions to perform. For example, as a first user is watching“Basic Instinct” and his grandmother walks into the room, the first usermay feel awkward or embarrassed to watch the movie with his grandmotherand, as a result, the first user may change the channel to a differentprogram. Based on this action by the first user, the system may modifythe stored relationship, tracking to perform an action every time thefirst user (e.g., grandson) and the second user (e.g., grandmother) aretogether in a room and certain content is playing. In some embodiments,the instruction to perform the action is based on the rating of thecontent. In some embodiments, the instruction to perform the action isbased on the rating and a category of the content. For example,restricted categories may include adult themes, adult activity, hardlanguage, intense or persistent violence, sexually oriented nudity, drugabuse or other elements.

In some embodiments, the system may identify a type of a social linkbetween the first user and the second user based on a respective userprofile. For example, the system may determine that the first user andthe second user are related, coworkers or friends. In some aspects ofthis embodiment, the system may determine that the second user may be aparent, a sibling, a grandparent, a cousin, an uncle, an aunt, a child,a friend, and a coworker of the first user. In some embodiments, uponidentifying a type of a social link between the first user and thesecond user, the system may by triggered by the same type of a sociallink with a third user to automatically perform a control action.Further, the system may identify an age difference between the firstuser and the second user. In some embodiments, upon identifying the typeof the social link and the age difference, the system may modify thestored relationship data based on the type of the social link, the agedifference and the received user command that controls playing the firstcontent.

In some embodiments, the type of a social link may be based on gender.For example, the first user may be a male coworker, and the second usermay be a female coworker. In yet another embodiments, the system mayidentify an age difference between the first user and the second userbased on the respective user profiles. In some embodiments, uponidentifying the type of the social link (e.g., gender) and the agedifference (e.g., greater than 20 years), the system may modify theexisting relationship data based on the received user command thatcontrols playing the first content. In some embodiments, the system mayemploy an age difference as the sole criterion to determine where toautomatically (i.e., without a user having to issue the command) performan action that controls the second content's playing. In someembodiments, the system may employ the type of social link (e.g.,gender) and the age difference (e.g., greater than 20 years) fordeciding whether to perform the control actions when a third user entersthe proximity of the media device. In some embodiments, based on the agedifference exceeding an age difference threshold (e.g., 20, 30 or 40years or another preselected age difference) between the first user andthe third user, or the second user and the third user, the system mayperform the control actions when a third user enters the proximity ofthe media device.

In some embodiments, the system further identifies a user action thatindicates disengagement from the playing of the first content. Forexample, in response to the second user entering the proximity of themedia device, the first user leaves the proximity of the media deviceplaying the first content, the first user engages with a second deviceor the first user looks away from the media device playing the firstcontent for an extended period. In some embodiments, the media devicemay include a camera system to identify each user and their actions. Insome embodiments, the system may use the camera system to capture thefirst user's actions. For example, the camera system may capture thatthe user looks away from the media device playing the first content foran extended period. Upon identifying the user action that indicatesdisengagement from the playing of the first content after the seconduser enters the media device's proximity, the system modifies the storedrelationship status that tracks the relationship between the first userand the second user.

In some embodiments, the system receives the command that controlsplaying the first content within a threshold time period of the seconduser entering the proximity of the media device. For example, the systemreceives the command within 5 seconds, 3 seconds or 1 second of thesecond user entering the proximity of the media device.

In some embodiments, the system detects the second user entering theproximity of the media device by determining a location of a mobiledevice associated with the respective user, performing a camera scanusing facial recognition, or listening to a voice using voicerecognition. In some embodiments, the system detects an additional,third user entering the proximity of the media device. In someembodiments, the system identifies the command that controls playing thefirst content performed by the first user in response to the additionaluser entering the proximity of the media device and modifies a storedrelationship status that tracks the relationship between the first user,the second user and the additional user. For example, the systemmodifies the stored relationship status based on all three users beingwithin the proximity of the device and the rating or category of thecontent fro which the first user performed the command.

In some embodiments, the system may identify a pattern in the storedrelationship status between the first user and the second user based onreceiving the command that controls playing the first content when thefirst user and the second user are both present. In some embodiments,the system may detect a third user who has a relationship with the firstuser similar to that of the the second user and the first user enteringthe proximity of the media device playing the first content, andmodifies a stored relationship status that tracks the relationshipbetween the first user and the third user. In some embodiments, thesystem detects the first user and the third user in the proximity of themedia device playing the first content and automatically performs thecommand that controls the playing of the second content item, whereinthe command is selected based on the stored relationship status thattracks the relationship between the first user and the third user.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other objects, advantages, and improvements of thedisclosure will be apparent upon consideration of the following detaileddescription, taken in conjunction with the accompanying drawings, inwhich like reference characters refer to like parts throughout, and inwhich:

FIG. 1 shows an illustrative example of a scenario for modifying astored relationship status based on a relationship and user feedbackand, at another time, automatically performing actions that control theplaying of certain content, in accordance with some embodiments of thepresent disclosure;

FIG. 2 depicts an illustrative example of a database for individualparental controls and relationship-based viewer control, in accordancewith some embodiments of the present disclosure;

FIG. 3 depicts an illustrative example of a database of control actionsbased on relationships, in accordance with some embodiments of thepresent disclosure;

FIG. 4 depicts exemplary devices and related hardware for modifying astored relationship status based on a relationship and user feedback andsubsequently automatically performing actions that control the playingof certain content, in accordance with some embodiments of the presentdisclosure;

FIG. 5 depicts exemplary systems and servers and related hardware formodifying a stored relationship status based on a relationship and userfeedback and thereafter automatically performing actions that controlthe playing of certain content, in accordance with some embodiments ofthe present disclosure;

FIG. 6 depicts an illustrative example of a content interfaceapplication from a media device for manually modifying a storedrelationship status based on user feedback and automatically performingactions that control the playing of certain content, in accordance withsome embodiments of the present disclosure;

FIG. 7 is a flowchart of a detailed illustrative process for modifying astored relationship status based on a relationship and user feedback andautomatically performing actions that control the playing of certaincontent, in accordance with some embodiments of the present disclosure;

FIG. 8 is a flowchart of a detailed illustrative process for identifyingthe relationship for the stored relationship status based on multipleusers in the proximity of the media device, in accordance with someembodiments of the present disclosure;

FIG. 9 depicts exemplary devices and related hardware for modifying astored relationship status based on a relationship and user feedback andautomatically performing actions that control the playing of thecontent, in accordance with some embodiments of the present disclosure;and

FIG. 10 depicts an exemplary process for modifying a stored relationshipstatus based on a relationship and user feedback and automaticallyperforming actions that control the playing of the content, inaccordance with some embodiments of the present disclosure.

DETAILED DESCRIPTION

FIG. 1 shows an illustrative example of a scenario for modifying astored relationship status based on a relationship and user feedback andautomatically performing actions (i.e., without user issuing thosecommands) that control the playing of the content, in accordance withsome embodiments of the present disclosure. For example, a first user, a20-year-old adult consumes content on a TV in a room. The content mayinclude are R-rated and PG-13 rated segments (e.g., “Titanic”). A seconduser (e.g., grandma) enters the room (e.g., proximity of the mediadevice). In response to grandma entering the room, the first user entersa command (e.g., change channel, change program, reduce volume, mutevolume, etc.). The system updates a relationship between the first user(e.g., adult) and second user (e.g., grandma) and the contentrestriction. At a subsequent time, when the first user is consuming asecond content item containing R-rated segments and the second userenters the room (e.g., proximity of the media device), the systemperforms a control action (e.g., change channel, change program, reducevolume, mute volume, etc.) automatically (i.e., without user issuingthose commands).

Returning to FIG. 1, as shown in step 1, at time t₁, a first user 102(e.g., adult) consumes (e.g., watches, listens to) first content(R-rated movie) on a computing device 104 in a proximity 108 of themedia device (e.g., the room where the first user 102 watches the firstcontent). For example, the first content may be output by a computingdevice 104 including a speaker connected to/integrated with thecomputing device 104. Although the computing device 104 is shown as adisplay device (e.g., a TV), the computing device 104 may be any userequipment with or without a display (e.g., a set-top box, a stereo, alaptop, or any other suitable output device). In some embodiments, ifthe computing device 104 is a display device, the computing device 104may play media content having a video portion and an audio portion(e.g., a movie).

While the first content is playing, a media device (e.g., the computingdevice 104) may monitor the proximity 108 of the media device for achange in the number of users in the proximity 108 of the media device.In some embodiments, a media device (e.g., the computing device 104) maydetect, at step 2, a second user (e.g., grandma) entering the proximityof the media device 108. For example, the media device may monitor theproximity 108 of the media device using a camera in the computing device104 and/or cameras in other user equipment (e.g., a TV, a smart homehub, the speaker connected to the computing device 104, or any otherdevice in the proximity 108 of the media device). However, this is onlyone example, and the media device may use any other suitablehardware/techniques to detect users in the proximity 108 of the mediadevice. For example, the media device may detect users directly (e.g.,by using imaging, radar, etc.) or indirectly (e.g., by detecting devicesassociated with the users). In some embodiments, the media device mayalso monitor the proximity 108 of the media device for background noise(e.g., by using a microphone in the user's equipment in the proximity108 of the media device).

At step 3, while the first content is playing, in response to detectinga second user (e.g., grandma) entering the proximity 108 of the mediadevice (e.g., entering room), the media device may receive 103 from adevice (e.g., a remote, smartphone, etc.) associated with the first usera command 103 (e.g., change channel, change program, reduce volume, mutevolume, etc.) that controls playing the first content. The receivedcommand may be to mute a volume of the media device playing the firstcontent, lower the volume of the media device playing the first content,or change a channel of the media device playing the first content. Instep 4, in response to receiving the command (e.g., change channel,change program, reduce volume, mute volume, etc.), the media device maymodify a stored relationship 109 between the first user 102 and thesecond user 106. In some embodiments, instead of receiving a command,the media device may detect a user action that indicates disengagementfrom the playing of the first content. For example, the user actionsthat indicate disengagement may be any one or more of the user turningtheir face away from the media device, focusing on a second mediadevice, leaving the room (e.g., leaving the proximity of the mediadevice) or any combination thereof. In some embodiments, the mediadevice may receive a command and then a user action that indicatesdisengagement from the playing of the first content. The device may useexisting individual parental controls associated with the respectiveusers to modify a combined authorization limit. For example, the devicemay update the relationship with the first user, the second user, thecontent being consumed and the received command.

In some embodiments, the stored relationship between the first user(e.g., adult) and the second user (e.g., grandma) may be stored in auser profile associated with one of the users or in the profiles of allof the users in the proximity of the media device 108. In someembodiments, the stored relationship between the first user and thesecond user, including a received command, may be one of a plurality ofstored relationship between the first user and the second user,including a received command, each associated with different commandsand different content in the proximity 108 of media device.

At step 5, the media device may subsequently detect a first user (e.g.,adult) consuming a second content, e.g., on the same or differentdevice. At step 6, the media device may detect a second user (e.g.,grandma) in the proximity of the media device 108. For example, asshown, at time t₂, the media device may detect second user 106 enter theproximity of media device 108 while a second content item is beingplayed. In some embodiments, the media device may maintain a table ofthe users in the proximity of media device 108 and update the table whena user enters or leaves the proximity of media device 108.

Based on the stored relationship status 109, the media device mayautomatically perform actions to control the playing of the secondcontent item without a user request for those actions. For example, asshown in FIGS. 2 and 3, when a relationship is modified with a command,the action to control the playing of content corresponding to thecommand may be automatically performed. For example, the media devicemay automatically perform an action to decrease the output volume by six(i.e., from “volume 14” to “volume 8”), change the channel to anotherchannel or program, play a commercial, insert a lower-rated version or acombination thereof. In some embodiments, the media device may furtheradjust the audio content's output volume based on other factors (e.g.,background noise in the proximity of the media device 108, a change inthe background noise, etc.). For example, the media device may furtheradjust the output volume to compensate for an increased or decreasedlevel of background noise. In some embodiments, a commercial that isretrieved from the memory may be inserted into the presentation of thecontent. In some embodiments, the commercial provides a delay betweenswitching from a R-rated version of a content to a PG-13 rated versionof the same content. The control actions are performed on content thateach of the users may individually consume but when together may notconsume. When one of the users in the proximity of the media deviceleaves and only one user remains in the proximity of the media device,the actions to control the playing of the content may be reversed (e.g.,volume increased to original volume, return to original channel).

The media device may receive a command 103 to control the playing ofcontent from a user in the proximity of media device 108. For example,the media device may receive a command to control the playing of content103 from the first user 102 to decrease the volume or to change thechannel automatically. The media device may receive a command to controlthe playing of content 103 through a user interface (e.g., a remotecontrol).

The media device may determine if the command to control the playing ofcontent 103 is received within a predetermined time after the seconduser enters the proximity 108 of the media device. In some embodiments,each command received also includes a confidence score that correlatesto the user's intentions. The confidence score may be derived based onthe latency of the command after the second user enters the proximity aswell as the repetition of the command. The higher the confidence scorefor each command, the faster the media device may perform the actionsthat control playing the second content. A delayed command may not occurin response to the second user entering the proximity of the mediadevice but for some other reason. For example, a first user entering acommand within a first threshold (e.g., 1 second) of the second userentering the proximity of the media device may correlate to a highconfidence score, while a command within a second threshold (e.g., 5seconds) may correlate to low confidence. On the other hand, a commandreceived after 10 seconds may not be in response to the second userentering the proximity. Further, the repetition of the command mayincrease the confidence score. For example, if the user entered thecommand multiple times, that will also increase the confidence score. Insome embodiments, the command may be associated to scenes of the movie,for example, “Titanic” includes R-rated scenes and PG-13 rated scenes.In this example, each time an R-rated scene is consumed, the first userenters a command. Such repetition of command will increase theconfidence score. In some embodiments, in response to the user notperforming an action, the system may cause the control circuitry toupdate the stored relationship status to indicate that no limitationsare present. Non-action by the user may also lead to a confidence score,which is correlated to the repetition of said non-action.

In some embodiments, the media device may record the time when thecommand to control the playing of content 103 is received. If the mediadevice determines that the command to control the playing of content 103is received within the predetermined time after the second user entersthe proximity of the media device (e.g., 1 second, 2 seconds, etc.), themedia device may infer that the first user 102 may feel awkward orembarrassed to watch the movie with the second user and may modify thestored relationship status 109. The predetermined time may correspond toan average time it takes a user to enter a command to change the channelor mute the volume (e.g., 2 seconds). In some embodiments, thepredetermined time may be adjusted based on user behavior (e.g., bydetermining the time it normally takes for the particular user toperform a command).

In some embodiments, the computing device 104 may output a notification(e.g., a visual notification) to inform the first user that the actionto control the second content item has been automatically performedbased on detecting a first user and second user in the proximity of themedia device 108. An example of the notification may be a message themedia device provides when grandma enters the proximity “we have changeda setting preference for you and grandma.” In some embodiments, thecomputing device may output a notification on a second device associatedwith the first user, for example, a text message that the second contentitem being consumed has been altered (e.g., reduced from R-rated toPG-13 rated) in response to grandma entering the room. In someembodiments, the notifications output to the first user's device mayprompt for user feedback (e.g., “Your grandma is in the room, do youwant to change the channel?”).

FIG. 2 depicts an illustrative example of a database for individualparental controls and relationship-based viewer control, in accordancewith some embodiments of the present disclosure. A media devicemaintains the database shown in FIG. 2. The database from FIG. 2 is adynamic viewer control for individual users with individual limits andmultiple users with combined limits. Each of the individual limits 202includes identifiers (e.g., first user, second user, third user, etc.),a name of the user and the individual limit associated with particularusers (e.g., no limit or PG-13). For example, the first user profileincludes the name “Eddie” and is associated with an individual limit of“No limit.” In some embodiments, each of the individual limitrestrictions may be stored in a user profile associated with aparticular user. As shown, the multi-user limits 204 are profiles basedon more than one user being in proximity of the media device. Forexample, a relationship profile is associated with two or moreparticular users. In some embodiments, in the event that the identity ofa user in the proximity of media device 108 cannot be determined, nocontrol actions may be saved. In some embodiments, in the event that theidentity of a user in the proximity of media device 108 cannot bedetermined, the media device may prompt the unidentified user to log into their user profile or to create a user profile. In some embodiments,the media device may automatically generate a new user profile for theunidentified user and associate a received command to control the mediadevice playing the first content with the new user profile. In someembodiments, the media device includes a machine learning feature thatadapts to the users to learn about the relationships and repeatsfunctions, thereby improving the enjoyment of the users' contentconsumption.

In some embodiments, the multi-user limits 204 may be determined inadvance (e.g., preset by the media device), based on characteristics ineach of the users' profiles (e.g., age, social link, gender, etc.), forexample, a rule that would limit the content based on a demographic withan age gap to avoid risqué scenes. The age gap may be manually set to10, 20, 30 years, or some other value. As shown, the combined limit ofeach relationship profile 204 may be adjusted to additional users. Insome embodiments, for each additional user in the proximity of the mediadevice, a new multi-user limit is created. As shown, the multi-userlimit varies from the individual limit based on the commands received.For example, based on a second user entering the proximity of the mediadevice, the media device may update the combined limit in response toreceiving commands. In some embodiments, the updated combined limit mayfurther be based on the particular scene. For example, if a sexuallyoriented nudity scene is displayed while the second user enters theproximity, the media device may update the profile based on the receivedcommand from the first user. In some embodiments, the command to controlthe media device playing the first content may be received in responseto a segment of the content being presented. For example, with norestrictions, a sexually oriented nudity scene comes on, and a commandis received. Based on receiving the command, a relationship profile fora first user and a second user in the proximity of the media device ismodified to include data about the command.

As shown in FIG. 2, the combined limit of each relationship profile 204may vary based on each user's preference. For example, each of the firstuser and third user from the individual limits 202 database of the mediadevice has no individual limits, i.e., they can consume any content withno restrictions individually. As shown in the combined limit for boththe first user and third user in the multi-user limit 204, when thefirst user (e.g., parent) is consuming content and the third user (e.g.,an adult child) enters, no additional restrictions are employed.However, when the third user (e.g., adult child) is consuming contentand the first user (e.g., parent) enters, the restrictions are reducedto PG-13. The content is further limited by the language, adultactivities and other elements. Similarly, when the third user (e.g.,adult child) is consuming content and the second user (e.g., grandma)enters, the restrictions are reduced to PG-13. The content is furtherlimited by the sexually oriented nudity. The system may determine asocial link between the third user and the second user and may apply thesame restrictions to another user with a similar social link, forexample, identifying a social link between the third user and the seconduser of a grandchild to grandmother, respectively. Based on the observedsocial link, another user, e.g., a second grandmother, may have similarrestrictions applied. In some embodiments, the content type may be thereason a user is uncomfortable consuming the content with the seconduser, and the combined restriction may be based solely on the contenttype.

FIG. 3 depicts an illustrative example of a database of control actionsbased on relationships, in accordance with some embodiments of thepresent disclosure. A media device maintains the database shown in FIG.3. As shown, the database from FIG. 3 shows multi-user limits 302 thatare based on profiles based on more than one user being in proximity ofthe media device. For example, a relationship profile is associated withtwo or more particular users. As shown, the database may track theusers, a received command, a confidence score for each multi-user limitand a predicted control action.

In some embodiments, the control command that is received and thepredicted control action are the same actions. For example, if the userenters a command to change the channel, the predicted action is also tochange the channel. In some embodiments, the control action is differentfrom the command received. Further, a confidence percent is developedover the course of a number of received commands and is based onrepetition. As the user continues to enter a particular command eachtime a second user enters the media device's proximity, the media deviceincreases the confidence score. For example, for each command that theuser enters in response to the second user entering proximity or a scenetriggering a command, the confidence profile may increase 25%, 33% orsome other value. In some embodiments, the confidence of the command hasto eclipse a certain threshold for the media device to perform theaction automatically. For example, a confidence score of greater than50% or 75% or some other preset value may cause control actions to beautomatically performed. In some embodiments, the user's commands orlack of commands may reset the confidence score or reduce the confidencescore for the command. For example, in response to the first user notproviding a command after the second user enters the room, the previouscommands may be reset. In another example, the restrictions may benarrowed to the specific content type. For example, if previouslycommands were received for R-rated content, and a subsequent R-ratedcontent does not receive a command, then the restrictions may be basedon a more specific content type, for example, a content type limited toone or more of the following content types: adult themes, adultactivity, hard language, intense or persistent violence, sexuallyoriented nudity, drug abuse or other elements or a combination thereof.

As shown in FIG. 3, the media device stores in memory instruction fortracking and performing control actions based on the relationshipprofiles between multiple users. In some embodiments, the media devicemonitors the control commands received and updates the storedrelationship status with the control commands. Based on the controlcommands, the media device may predict the control action to performautomatically based on the confidence score. For example, a first usermay enter a change channel command for each time a second user entersthe room, and in response, the system may predict a control action tochange the channel the next time the second user enters the room and thesame content type is being consumed. In some embodiments, the predictedcontrol action may be different from the received command. For example,a command is obtained each time the second user enters the room, but thecommand varies. In such an example, the control action may be randomlyselected, or a most conservative control action may be employed. Themost conservative action may be when the video and audio are changedupon the second user entering the room.

In some embodiments, the system may determine a social link between thethird user and the second user and may apply the same restrictions toanother user with a similar social link, for example, identifying asocial link between the third user and the second user of a grandchildto grandmother, respectively, with a predicted control action and aconfidence score of 100. Based on the observed social link, anotheruser, e.g., a second grandmother, may have similar restrictions appliedwith the same predicted control actions and a reduced confidence score.In some embodiments, in response to performing the control action andthe user not correcting the automatically performed action, theconfidence score is increased.

FIG. 4 describes exemplary devices and related hardware for modifying astored relationship status based on a relationship and user feedback andautomatically performing actions that control the playing of thecontent, in accordance with some embodiments of the present disclosure.FIG. 4 shows generalized embodiments of illustrative user equipmentdevices 400 and 401. For example, user equipment device 400 may be asmartphone device. In another example, user equipment system 401 may bea user television equipment system (e.g., the computing device 106). Inyet another example, the user equipment system 401 may be a mediadevice. The user television equipment system 401 may include a set-topbox 416. The set-top box 416 may be communicatively connected to acamera 420, a microphone 418, a speaker 414, and a display 412. In someembodiments, the camera may detect users in the media presentationenvironment (i.e., the proximity of the media device). In someembodiments, the microphone 418 may detect sound (e.g., backgroundnoise) in the media presentation environment. In some embodiments, thedisplay 412 may be a television display or a computer display (i.e., theproximity of the media device). In some embodiments, the set-top box 416may be communicatively connected to a user input interface 410. In someembodiments, the user input interface 410 may be a remote-control device(e.g., the remote control). The set-top box 416 may include one or morecircuit boards. In some embodiments, the circuit boards may includeprocessing circuitry, control circuitry, and storage (e.g., RAM, ROM,hard disk, removable disk, etc.). In some embodiments, the circuitboards may include an input/output path. More specific implementationsof user equipment devices are discussed below in connection with FIG. 6.Each one of the user equipment device 400 and the user equipment system401 may receive content and data via input/output (I/O) path 402. TheI/O path 402 may provide content (e.g., broadcast programming, on-demandprogramming, Internet content, content available over a local areanetwork (LAN) or wide area network (WAN), and/or other content) and datato control circuitry 404, which includes processing circuitry 406 and astorage 408. The control circuitry 404 may be used to send and receivecommands, requests, and other suitable data using the I/O path 402. TheI/O path 402 may connect the control circuitry 404 (and specifically theprocessing circuitry 406) to one or more communications paths (describedbelow). I/O functions may be provided by one or more of thesecommunications paths, but are shown as a single path in FIG. 4 to avoidovercomplicating the drawing.

The control circuitry 404 may be based on any suitable processingcircuitry, such as the processing circuitry 406. As referred to herein,processing circuitry should be understood to mean circuitry based on oneor more microprocessors, microcontrollers, digital signal processors,programmable logic devices, field-programmable gate arrays (FPGAs),application-specific integrated circuits (ASICs), etc., and may includea multi-core processor (e.g., dual-core, quad-core, hexa-core, or anysuitable number of cores) or supercomputer. In some embodiments,processing circuitry may be distributed across multiple separateprocessors or processing units, for example, multiple of the same typeof processing units (e.g., two Intel Core i7 processors) or multipledifferent processors (e.g., an Intel Core i5 processor and an Intel Corei7 processor). In some embodiments, the control circuitry 404 executesinstructions for a media device stored in memory (i.e., the storage408). Specifically, the control circuitry 404 may be instructed by themedia device to perform the functions discussed above and below. In someimplementations, any action performed by the control circuitry 404 maybe based on instructions received from the media device.

In client/server-based embodiments, the control circuitry 404 mayinclude communications circuitry suitable for communicating with a mediadevice server or other networks or servers. The instructions forcarrying out the above-mentioned functionality may be stored on a server(which is described in more detail in connection with FIG. 5).Communications circuitry may include a cable modem, an integratedservices digital network (ISDN) modem, a digital subscriber line (DSL)modem, a telephone modem, an Ethernet card, or a wireless modem forcommunications with other equipment, or any other suitablecommunications circuitry. Such communications may involve the Internetor any other suitable communication networks or paths (which isdescribed in more detail in connection with FIG. 5). In addition,communications circuitry may include circuitry that enables peer-to-peercommunication of user equipment devices, or communication of userequipment devices in locations remote from each other (described in moredetail below).

Memory may be an electronic storage device provided as the storage 408that is part of the control circuitry 404. As referred to herein, thephrase “electronic storage device” or “storage device” should beunderstood to mean any device for storing electronic data, computersoftware, or firmware, such as random-access memory, read-only memory,hard drives, optical drives, digital video recorders (DVRs, sometimescalled personal video recorders, or PVRs), solid state devices, quantumstorage devices, gaming consoles, gaming media, or any other suitablefixed or removable storage devices, and/or any combination of the same.The storage 408 may be used to store various types of content describedherein as well as media device data described above. For example, thestorage 408 may be used to store the output volume adjustment profilesdescribed in FIG. 2. Nonvolatile memory may also be used (e.g., tolaunch a boot-up routine and other instructions). Cloud-based storage,described in relation to FIG. 5, may be used to supplement the storage408 or instead of the storage 408.

The control circuitry 404 may include video generating circuitry andtuning circuitry, such as one or more analog tuners, one or more MPEG-2decoders or other digital decoding circuitry, high-definition tuners, orany other suitable tuning or video circuits or combinations of suchcircuits. Encoding circuitry (e.g., for converting over-the-air, analog,or digital signals to MPEG signals for storage) may also be provided.The control circuitry 404 may also include scaler circuitry forupconverting and downconverting content into the preferred output formatof the user equipment 400. The circuitry 404 may also includedigital-to-analog converter circuitry and analog-to-digital convertercircuitry for converting between digital and analog signals. The tuningand encoding circuitry may be used by the user equipment device toreceive and to display, to play, or to record content. The tuning andencoding circuitry may also be used to receive guidance data. Thecircuitry described herein, including for example, the tuning, videogenerating, encoding, decoding, encrypting, decrypting, scaler, andanalog/digital circuitry, may be implemented using software running onone or more general-purpose or specialized processors. Multiple tunersmay be provided to handle simultaneous tuning functions (e.g., watch andrecord functions, picture-in-picture (PIP) functions, multiple-tunerrecording, etc.). If the storage 408 is provided as a separate devicefrom the user equipment device 400, the tuning and encoding circuitry(including multiple tuners) may be associated with the storage 408.

A user may send instructions to the control circuitry 404 using the userinput interface 410. The user input interface 410 may be any suitableuser interface, such as a remote control, mouse, trackball, keypad,keyboard, touchscreen, touchpad, stylus input, joystick, voicerecognition interface, or other user input interfaces. The display 412may be provided as a stand-alone device or integrated with otherelements of each one of the user equipment device 400 and the userequipment system 401. For example, the display 412 may be a touchscreenor touch-sensitive display. In such circumstances, the user inputinterface 410 may be integrated with or combined with display 412. Thedisplay 412 may be one or more of a monitor, a television, a display fora mobile device, or any other type of display. A video card or graphicscard may generate the output to the display 412. The video card may beany processing circuitry described above in relation to the controlcircuitry 404. The video card may be integrated with the controlcircuitry 404. Speakers 414 may be provided as integrated with otherelements of each one of the user equipment device 400 and the userequipment system 401 or may be stand-alone units. The audio component ofvideos and other content displayed on the display 412 may be playedthrough the speakers 414. In some embodiments, the audio may bedistributed to a receiver (not shown), which processes and outputs theaudio via speakers 414.

The media device may be implemented using any suitable architecture. Forexample, it may be a stand-alone application wholly implemented on eachone of the user equipment device 400 and the user equipment system 401.In such an approach, instructions of the application are stored locally(e.g., in the storage 408), and data for use by the application isdownloaded on a periodic basis (e.g., from an out-of-band feed, from anInternet resource, or using another suitable approach). The controlcircuitry 404 may retrieve instructions of the application from thestorage 408 and process the instructions to rearrange the segments asdiscussed. Based on the processed instructions, the control circuitry404 may determine what action to perform when input is received from theuser input interface 410. For example, movement of a cursor on a displayup/down may be indicated by the processed instructions when the userinput interface 410 indicates that an up/down button was selected.

In some embodiments, the media device is a client/server-basedapplication. Data for use by a thick or thin client implemented on eachone of the user equipment device 400 and the user equipment system 401is retrieved on demand by issuing requests to a server remote to eachone of the user equipment device 400 and the user equipment system 401.In one example of a client/server-based guidance application, thecontrol circuitry 404 runs a web browser that interprets web pagesprovided by a remote server. For example, the remote server may storethe instructions for the application in a storage device. The remoteserver may process the stored instructions using circuitry (e.g., thecontrol circuitry 404) and to modify a stored relationship status basedon a relationship and user feedback and to perform actions automaticallythat control the playing of the content as discussed. In someembodiments, the remote server may process the stored instructions usingcircuitry (e.g., the control circuitry 404) based a change in the numberof users in the proximity of the media device. For example, a seconduser entering the proximity and similarly leaving the proximity.

In some embodiments, the media device is downloaded and interpreted orotherwise run by an interpreter or virtual machine (run by the controlcircuitry 404). In some embodiments, the media device may be encoded inthe ETV Binary Interchange Format (EBIF), received by the controlcircuitry 404 as part of a suitable feed, and interpreted by a useragent running on the control circuitry 404. For example, the mediadevice may be an EBIF application. In some embodiments, the media devicemay be defined by a series of JAVA-based files that are received and runby a local virtual machine or other suitable middleware executed bycontrol circuitry 404. In some of such embodiments (e.g., thoseemploying MPEG-2 or other digital media encoding schemes), the mediadevice may be, for example, encoded and transmitted in an MPEG-2 objectcarousel with the MPEG audio and video packets of a program.

FIG. 5 describes exemplary systems and servers, and related hardware formodifying a stored relationship status based on a relationship and userfeedback and automatically performing actions that control the playingof the content, in accordance with some embodiments of the presentdisclosure. User equipment devices 508 and 510 (such as the computingdevice 106) may be coupled to communication network 506. Thecommunication network 506 may be one or more networks including theInternet, a mobile phone network, mobile voice or data network (e.g., a4G or LTE network), cable network, public switched telephone network, orother types of communication network or combinations of communicationnetworks. Paths (e.g., depicted as arrows connecting the respectivedevices to the communication network 506) may separately or togetherinclude one or more communications paths, such as a satellite path, afiber-optic path, a cable path, a path that supports Internetcommunications (e.g., IPTV), free-space connections (e.g., for broadcastor other wireless signals), or any other suitable wired or wirelesscommunications path or combination of such paths. Communications withthe client devices may be provided by one or more of thesecommunications paths but are shown as a single path in FIG. 5 to avoidovercomplicating the drawing.

Although communications paths are not drawn between user equipmentdevices, these devices may communicate directly with each other viacommunications paths such as short-range communication paths,point-to-point communications paths, such as USB cables, IEEE 1394cables, wireless paths (e.g., Bluetooth, infrared, IEEE 802-11x, etc.),or other short-range communication via wired or wireless paths. The userequipment devices may also communicate with each other directly throughan indirect path via the communication network 506.

The system 500 includes a media content source 502 and a server 504.Communications with the media content source 502 and the server 504 maybe exchanged over one or more communications paths but are shown as asingle path in FIG. 5 to avoid overcomplicating the drawing. Inaddition, there may be more than one of each of the media content source502 and the server 504, but only one of each is shown in FIG. 5 to avoidovercomplicating the drawing. If desired, the media content source 502and the server 504 may be integrated as one source device.

In some embodiments, the server 504 may include control circuitry 511and a storage 514 (e.g., RAM, ROM, hard disk, removable disk, etc.). Theserver 504 may also include an input/output path 512. The I/O path 512may provide device information, or other data, over a local area network(LAN) or wide area network (WAN), and/or other content and data to thecontrol circuitry 511, which includes processing circuitry, and thestorage 514. The control circuitry 511 may be used to send and receivecommands, requests, and other suitable data using the I/O path 512. TheI/O path 512 may connect the control circuitry 511 (and specificallyprocessing circuitry) to one or more communications paths.

The control circuitry 511 may be based on any suitable processingcircuitry such as one or more microprocessors, microcontrollers, digitalsignal processors, programmable logic devices, field-programmable gatearrays (FPGAs), application-specific integrated circuits (ASICs), etc.,and may include a multi-core processor (e.g., dual-core, quad-core,hexa-core, or any suitable number of cores) or supercomputer. In someembodiments, control circuitry 511 may be distributed across multipleseparate processors or processing units, for example, multiple of thesame type of processing units (e.g., two Intel Core i7 processors) ormultiple different processors (e.g., an Intel Core i5 processor and anIntel Core i7 processor). In some embodiments, the control circuitry 511executes instructions for an emulation system application stored inmemory (e.g., the storage 514). Memory may be an electronic storagedevice provided as the storage 514 that is part of the control circuitry511.

The server 504 may retrieve guidance data from media content source 502,process the data as will be described in detail below, and forward thedata to the user equipment devices 508 and 510. The media content source502 may include one or more types of content distribution equipmentincluding an audio distribution facility, a television distributionfacility, cable system headend, satellite distribution facility,programming sources (e.g., television broadcasters, such as NBC, ABC,HBO, etc.), intermediate distribution facilities and/or servers,Internet providers, on-demand media servers, and other contentproviders. NBC is a trademark owned by the National BroadcastingCompany, Inc., ABC is a trademark owned by the American BroadcastingCompany, Inc., and HBO is a trademark owned by the Home Box Office, Inc.Media content source 502 may be the originator of content (e.g., atelevision broadcaster, a Webcast provider, etc.) or may not be theoriginator of content (e.g., an on-demand content provider, an Internetprovider of content of broadcast programs for downloading, etc.). Themedia content source 502 may include cable sources, satellite providers,on-demand providers, Internet providers, over-the-top content providers,or other providers of content. The media content source 502 may alsoinclude a remote media server used to store different types of content(including video content selected by a user) in a location remote fromany of the client devices.

Client devices may operate in a cloud computing environment to accesscloud services. In a cloud computing environment, various types ofcomputing services for content sharing, storage or distribution (e.g.,video sharing sites or social networking sites) are provided by acollection of network-accessible computing and storage resources,referred to as “the cloud.” For example, the cloud can include acollection of server computing devices (such as, e.g., server 504),which may be located centrally or at distributed locations, that providecloud-based services to various types of users and devices connected viaa network (such as the Internet) via communication network 506. In suchembodiments, user equipment devices may operate in a peer-to-peer mannerwithout communicating with a central server.

FIG. 6 depicts an illustrative example of a content interfaceapplication from a media device for manually entering a storedrelationship status based on user feedback and automatically performingactions that control the playing of the content, in accordance with someembodiments of the present disclosure. In some embodiments, the contentinterface application may be launched on demand or when a user enters anew relationship. For example, the on-demand application is activatedwhen a new user enters the proximity of the media device, and it promptsfor user feedback. In another embodiment, the user relationships areentered by the user manually. In some embodiments, the system may entera new rule based on the confidence observed, as discussed above. Thecontent interface application 600 may include illustrative devicedisplay 602 for inputting the desired relationship policy. The contentinterface application 600 may include a smartphone or other suitableuser device configured to receive and send a policy inputted by anauthorized user (e.g., first user, second user). As illustrated, devicedisplay 602 shows an option for selecting individual parental controlfor each user from a list of potential users as well as an authorizationbased on a plurality of users. The list may be accessed from storage inthe database or manually entered. For example, an authorized user maymanually enter a relationship policy for each relationship between twoor more users. As illustrated, device display 602 shows an option forselecting a first user 604 from a list of potential users as well asoptions for a parental control restriction 610 from a list of potentialratings and categories of the content. For example, the rating may beNC, R, PG-13, PG, G and categories include adult themes, adult activity,hard language, intense or persistent violence, sexually oriented nudity,drug abuse or other elements or a combination thereof. In someembodiments, the system may provide the manual entry based on one of theauthorization control restrictions or content type. Similarly, thedevice further shows an option for selecting a second user 606 and asecond authorization level 612 associated with the second user.

The device further shows an option for selecting a relationship 608based option, which includes two or more users (e.g., first user andsecond user) from a list of potential users, and the list may beaccessed from storage in the database or manually entered. In someembodiments, the device further includes options for an authorizationcontrol restriction 614 associated with the relationship 608 from a listof restrictions that may be based on a rating or a category. Forexample, the rating may be NC, R, PG-13, PG, G and categories includeadult themes, adult activity, hard language, intense or persistentviolence, sexually oriented nudity, drug abuse or other elements or acombination thereof.

List of potential users 603, as illustrated, includes a contact list,coworkers and family members stored in the memory of device 600. A listof potential relationships 607 includes two or more users selected fromlist of potential users 603. A list of potential relationships 607, asillustrated, includes a vertical list with a scroll bar for navigatingthe list. The list of potential relationships 607 is updated andobserved for patterns based on the social link, and an age differencethat may be employed for updating system behavior with additional users.

FIG. 7 is a flowchart of a detailed illustrative process for modifying astored relationship status based on a relationship and user feedback andautomatically performing actions that control the playing of thecontent, in accordance with some embodiments of the present disclosure.The process 700 may be executed by the control circuitry 404 (e.g., in amanner instructed to the control circuitry 404 by the media device). Thecontrol circuitry 404 may be part of user equipment (e.g., a device thatmay have any or all of the functionality of the user equipment devices508 or 510) or of a remote server separated from the user equipment byway of the communication network 506, or distributed over a combinationof both. It should be noted that the process 700, or any step thereof,could be performed on, or provided by, any of the devices shown in FIGS.1 and 4-5.

The process 700 begins at step 702, when the control circuitry (e.g., ofdevice 508 and/or 510) detects, via a computing device (e.g., the userequipment device 400 or the user television equipment system 401) afirst user in proximity (e.g., the media device proximity 108), of themedia device playing the first content.

At step 704, the media device (e.g., via the control circuitry 404)detects a second user entering the proximity of the media device playingthe first content. For example, the control circuitry 404 may processsignals from camera 420 to detect users in the proximity of the mediadevice. In some embodiments, the media device (e.g., via the controlcircuitry 404) may detect a change in the number of users in theproximity of the media device. For example, the media device maydetermine if a user enters or leaves the proximity of the media device.If the control circuitry 404 determines that a second user has notentered the proximity of the media device (“No” at 704), the process 700may return back to 702 and continue to detect the first user in theproximity of the media device playing the first content. Otherwise, ifthe control circuitry 404 detects a second user entering the proximityof the media device playing the first content (“Yes” at 704), theprocess 700 may proceed to step 706.

At step 706, the media device (e.g., via the control circuitry 404),receives a command that controls playing the first content after thesecond user enters the proximity of the media device, for example, tolower the volume of the media device playing the first content, orchange a channel of the media device playing the first content. If thecontrol circuitry 404 does not receive a command that controls playingthe first content, after the second user enters the proximity of themedia device (“No” at 706), the process 700 may return to 702 andcontinue to monitor the proximity of the media device playing the firstcontent. Otherwise, if the control circuitry 404 receives a command thatcontrols playing the first content after the second user enters theproximity of the media device (“Yes” at 706), the process 700 mayproceed to step 708.

In some embodiments, the media device (e.g., via the control circuitry404) determines if the command that controls playing the first contentwas received within a predetermined time from the user entering theproximity of the media device. For example, the control circuitry 404may determine whether the command that controls playing the firstcontent is within the predetermined time to determine if the commandthat controls playing the first content is related to the second userentering the proximity of the media device. If the control circuitry 404determines that the command that controls playing the first content wasnot received within the predetermined time from the second user enteringthe proximity of the media device, the process 700 may return to 702 andcontinue to monitor the proximity of the media device. Otherwise, if thecontrol circuitry 404 determines that the command that controls playingthe first content was received within the predetermined time from thesecond user entering the proximity of the media device, the process 700may proceed to step 708.

In some embodiments, instead of receiving a command, the media devicemay identify a user action that indicates disengagement from the playingof the first content. For example, the user actions that indicatedisengagement may be any one or more of turning a user's face away fromthe media device, focusing on a second media device, leaving the room(e.g., leaving the proximity of the media device) or any combinationthereof. In some embodiments, the media device may receive a user actionthat indicates disengagement from the playing of the first content.

At step 708, the media device (e.g., via the control circuitry 404)modifies a stored relationship status that tracks a relationship betweenthe first user and the second user based on the received command. Forexample, the stored relationship status is updated with a command thatcontrols playing the first content to change the channel every time bothusers are in the proximity of the media device and the new contentmatches the restrictions of the first content. For example, the controlcircuitry 404 updates the stored relationship status in a storage (e.g.,the storage 408), based on a command that controls playing the firstcontent (e.g., by overwriting the previously stored relationshipstatus). The media device may determine a different command each timethe second user enters the proximity of the media device. In someembodiments, based on the number of repeat commands (e.g., same commandon two events), a confidence score is applied to the command, such achange in output volume adjustment values corresponding to the detectedchange in the number of users.

At step 710, the media device (e.g., via the control circuitry 404)detects the first user and the second user in the proximity of the mediadevice playing a second content. For example, the media device maydetect the first user and the second user in the proximity of the mediadevice playing a second content. In some embodiments, the second contentitem may be rated similarly to the first content item.

At step 712, the media device automatically performs an action (e.g.,via the control circuitry 404) that controls the playing of the secondcontent. For example, the media device decreases the output volume levelbased on the command received on the first content. In another example,the media device may change the channel similar to the command receivedon the first content. In some embodiments, the media device may performan action that is different than the received command, for example,inserting an advertisement into the presentation of the content during asegment that triggered the rating. In another example, the media devicemay search for the content (e.g., movie) from a database server that isformatted to be a lower authorization restriction and may automaticallyreplace the higher restricted content (e.g., R-rated) with the lowerrestricted content (e.g., Rated PG).

FIG. 8 is a flowchart of a detailed illustrative process for identifyingthe relationship for the stored relationship status based on multipleusers in the proximity of the media device, in accordance with someembodiments of the present disclosure. Process 800 is one embodiment ofa method for identifying a relationship between a first user and asecond user of FIG. 7. Process 800 begins at step 802, when the mediadevice (e.g., via the control circuitry 404) detects, via a computingdevice (e.g., the user equipment device 400 or the user televisionequipment system 401) a first user in proximity (e.g., the media deviceproximity 108), of the media device playing the first content. Forexample, the control circuitry 404 may process signals from the camera420 to identify users in the media presentation environment (e.g., usingfacial recognition techniques). For example, the control circuitry 404may compare captured images of the users in the proximity of the mediadevice to images stored in user profiles. In some embodiments, if thecontrol circuitry 404 is unable to identify users in the proximity ofthe media device, the control circuitry may automatically create a userprofile for one or more of the users or prompt one or more of the usersto create a user profile.

At step 804, similar to step 704, the media device (e.g., via thecontrol circuitry 404) detects a second user entering the proximity ofthe media device playing the first content. For example, the controlcircuitry 404 may process signals from the camera 420 or via a mobiledevice associated with the second user coming into Bluetooth range todetect users in the proximity of the media device. If the controlcircuitry 404 determines that a second user has not entered theproximity of the media device (“No” at 804), the process 800 may returnback to 802 and continue to monitor the first user in the proximity ofthe media device playing the first content. Otherwise, if the controlcircuitry 404 detects a second user entering the proximity of the mediadevice playing the first content (“Yes” at 804), the process 800 mayproceed to step 806. In some embodiments, if the control circuitry 404is unable to identify additional users in the proximity of the mediadevice, the control circuitry may automatically create a user profilefor one or more of the users or prompt one or more of the users tocreate a user profile, or may search for the one or more of the usersusing social media to determine if the user belongs in a restrictedgroup (e.g., sisters, brothers, coworkers, grandparents, etc.). Forexample, the second user may be similar to another user that has a userprofile and a relationship restriction with the first user. Based onidentifying the second user as belonging to the restricted group, thesystem may apply similar actions that control the playing of content onthe media device.

At step 806, the media device (e.g., via the control circuitry 404),identifies a type of a social link between the first user and the seconduser. The device determines based on the respective user's profiles thetype of a social link. For example, the type of a social link mayinclude a parent, a sibling, a grandparent, a cousin, an uncle, an aunt,a child, a friend, and a coworker. If the control circuitry 404identifies no type of a social link between the first user and thesecond user (“No” at 806), the process 800 may return to 802 andcontinue to detect the first user in the proximity of the media deviceplaying the first content. Otherwise, if the control circuitry 404identifies a type of a social link between the first user and the seconduser (“Yes” at 806), the process 800 may proceed to step 808.

At step 808, the media device (e.g., via the control circuitry 404)identifies an age difference between the first user and the second user.The device determines, based on the respective users' profiles, the agedifference. In some embodiments, different types of social links mayhave additional age-difference criteria. For example, an age-differencecriterion for a coworker of greater than 5 years may trigger monitoringof commands received. On the other hand, an age difference criterion fora cousin of greater than 15 years may trigger command monitoring. Theage difference may be manually set or a default value. If the controlcircuitry 404 identifies no age difference or no age difference greaterthan the age difference criteria for that type of social link betweenthe first user and the second user (“No” at 808), the process 800 mayreturn to 802 and continue to detect the first user in the proximity ofthe media device playing the first content. Otherwise, if the controlcircuitry 404 identifies an age difference or an age difference greaterthan the age difference criterion for that type of social link betweenthe first user and the second user (“Yes” at 808), the process 800 mayproceed to step 810.

At step 810, the media device (e.g., via the control circuitry 404)receives a command that controls playing the first content after thesecond user enters the proximity of the media device, for example, thefirst user enters a command to lower the volume of the media deviceplaying the first content, or change a channel of the media deviceplaying the first content. If the control circuitry 404 does not receivea command that controls playing the first content after the second userenters the proximity of the media device (“No” at 810), the process 800may return to 802 and continue to detect the first user in the proximityof the media device playing the first content. Otherwise, if the controlcircuitry 404 receives a command that controls playing the first contentafter the second user enters the proximity of the media device (“Yes” at810), the process 800 may proceed to step 812, in particular, to step708 of FIG. 7.

FIG. 9 describes exemplary devices and related hardware for modifying astored relationship status based on a relationship and user feedback andautomatically performing actions that control the playing of thecontent, in accordance with some embodiments of the present disclosure.As shown in FIG. 9, the exemplary system includes a multiple userrelationship 901, a detection module 902, a relationship detectionmodule 904, a dynamic content restriction 906, a player 908, a serverwith different manifests 910 and a content rating analyzer 912. Themultiple user relationship 901 includes more than one user and is uniqueto each individual users. For example, a first user and second user willhave a relationship.

In some embodiments, the detection module 902 is configured with audioand video detections sensors or any other form of detection sensorsconfigured to detect the user (e.g., first user and second user) in theroom (e.g., the proximity of media device). The detection module 902 maybe a part of multimedia system or some integrated Internet of Things(IoT) system, where the integrated Things are embedded with sensors,software, and other technologies to connect and exchange data with otherdevices and systems over the Internet and through computer intelligence.Computer-based vision techniques coupled to the camera systems can beused to detect exact users.

In some embodiments, the relationship detections module 904 isconfigured to construct profiles and relationships of differentindividuals. For example, the relationship detection module 904 maydetermine the social link between the first user and the second user. Insome embodiments, the relationship detections module 904 may beconfigured as part of a static system, where the user input updates thesystem. In another example, the relationship detections module 904 maybe configured as part of an intelligent system that adapts and updatesits actions dynamically through intelligent learning. The relationshipdetections module 904 may be configured to detect user commandscompelled by awkwardness.

In some embodiments, dynamic content restriction 906 is configured tomake decisions based on the relationship graph formed after detectingmultiple users. For example, dynamic content restriction 906communicates with all the modules to determine if multiple users arepresent and if a relationship exists based on user feedback. In oneexample, the system detects a father consuming explicit content, andsuddenly detects that a child enters the room where the father isconsuming explicit content. In response to detecting the second user(e.g., child), the dynamic content restriction 906 automaticallyperforms a control action on the media device to mute/stop/substitutethe content being consumed.

In some embodiments, media device (player) 908 is configured to interactwith the dynamic content restriction 906. The media device (player) 908is configured to mute the content/blur the content/substitute thecontent on detection of any explicit level which the first user may beuncomfortable in consuming with the second user (e.g., child) present.

In some embodiments, a server with different manifest 910 is accessed toretrieve content that is suitable to a reduce restriction level based ona relationship (grandchild to grandma).

In some embodiments, the content rating analyzer 912 is configured toperform a content rating analysis. For example, the content ratinganalyzer 912 is an intelligent module which assigns explicitness levelsto all segments of the content (e.g., scenes of a movie). Theseexplicitness levels can be attached as a metadata to each frame or towhole segments. Based on the explicitness level, the relationship-basedmultiple user restrictions may apply control actions to specific scenesrather than the entire movie. In some embodiments, multiple versions ofa content may be retrieved from the server based on explicitness level,a parental restriction level or some other level. In some embodiments, ahigher restriction level (e.g., R-rated) version of a movie may need tobe substituted with a reduced restriction level (e.g., rated PG-13)version of a movie based on a relationship to avoid awkwardness.

FIG. 10 describes an exemplary process for modifying a storedrelationship status based on a relationship and user feedback andautomatically performing actions that control the playing of thecontent, in accordance with some embodiments of the present disclosure.As shown in FIG. 10, the exemplary process includes the following steps:viewer plays the content 1002 at the user equipment, identify content tobe streamed 1004 at the server, detect users' profiles 1006 at the userequipment, assign ratings to each segment 1008 of the content at theserver, select the appropriate parental control track based on viewerssurroundings profiling and available tracks 1010 at the user equipment,content is delivered via Content Delivery Network (CDN) 1012 at theserver and content start playback 1014 at the user equipment. The steps,as illustrated in FIG. 10 are described in more detail in connectionwith FIGS. 7 and 8 above.

The process 1000 may be executed by the control circuitry 404 (e.g., ina manner instructed to the control circuitry 404 by the media device).The control circuitry 404 may be part of user equipment (e.g., a devicethat may have any or all of the functionality of the user equipmentdevices 508 or 510) or of a remote server separated from the userequipment by way of the communication network 506, or distributed over acombination of both. It should be noted that the process 1000, or anystep thereof, could be performed on, or provided by, any of the devicesshown in FIGS. 1 and 4-5. It should also be noted that the process 1000,or any step thereof, may be substituted and replaced by any of the otherprocess steps discussed in the application.

The processes described above are intended to be illustrative and notlimiting. One skilled in the art would appreciate that the steps of theprocesses discussed herein may be omitted, modified, combined, and/orrearranged, and any additional steps may be performed without departingfrom the scope of the invention. More generally, the above disclosure ismeant to be exemplary and not limiting. Only the claims that follow aremeant to set bounds as to what the present invention includes.Furthermore, it should be noted that the features and limitationsdescribed in any one embodiment may be applied to any other embodimentherein, and flowcharts or examples relating to one embodiment may becombined with any other embodiment in a suitable manner, done indifferent orders, or done in parallel. In addition, the systems andmethods described herein may be performed in real time. It should alsobe noted that the systems and/or methods described above may be appliedto or used in accordance with other systems and/or methods.

What is claimed is:
 1. A method comprising: detecting a first user inproximity of a media device playing a first content; detecting a seconduser entering the proximity of the media device playing the firstcontent; receiving a command that controls playing the first content,after the second user entering the proximity of the media device; inresponse to the receiving the command that controls the playing thefirst content after the second user enters the proximity of the mediadevice, modifying a stored relationship status that tracks arelationship between the first user and the second user; detecting thefirst user and the second user in the proximity of the media deviceplaying a second content; in response to the detecting the first userand the second user in the proximity of the media device playing thesecond content, automatically performing an action that controls theplaying of the second content, wherein the action is selected based onthe stored relationship status that tracks the relationship between thefirst user and the second user; determining a third user with a similarrelationship with the first user as the second user entering theproximity of the media device playing the first content; identifying apattern in the stored relationship status between the first user and thesecond user based on the receiving the command that controls playing thefirst content between the first user and the second user; modifying astored relationship status that tracks the relationship between thefirst user and the third user based on the receiving the command thatcontrols playing the first content between the first user and the seconduser; detecting the first user and the third user in the proximity ofthe media device playing the first content; and in response to thedetecting the first user and the third user in the proximity of themedia device playing the first content, automatically performing thecommand that controls the playing of the second content, wherein thecommand is selected based on the stored relationship status that tracksthe relationship between the first user and the third user.
 2. Themethod of claim 1, wherein performing the action that controls theplaying of the second content comprises performing the command thatcontrols playing the first content.
 3. The method of claim 2, whereinperforming the action that controls the playing of the second content isnot performed when just one user of the first user and the second useris in the proximity of the media device, but is performed when bothusers of the first user and the second user are detected in theproximity of the media device.
 4. The method of claim 1, whereinperforming the action that controls the playing of the second contentcomprises performing the action without receiving the command from thefirst user to perform the command.
 5. The method of claim 1, wherein themodifying the stored relationship status between the first user and thesecond user comprises: retrieving an existing relationship data betweenthe first user and the second user based on a first user profileassociated with the first user and a second user profile associated withthe second user; identifying a type of a social link between the firstuser and the second user based on the respective user profile, whereinthe type of the social link comprises one or more of a parent, asibling, a grandparent, a cousin, an uncle, an aunt, a child, a friend,and a coworker; identifying an age difference between the first user andthe second user based on the respective user profile; and in response toidentifying the type of the social link and the age difference,modifying the existing relationship data based on the type of the sociallink and the action that controls playing the first content.
 6. Themethod of claim 1, wherein the action that controls playing the secondcontent comprises one or more of muting a volume of the media deviceplaying the first content, lowering volume of the media device playingthe first content, or changing a channel of the media device playing thefirst content.
 7. The method of claim 1, further comprising: identifyinga user action that indicates disengagement from the playing of the firstcontent, wherein the user action that indicates disengagement from theplaying of the first content comprises one or more of the first userleaving the proximity of the media device playing the first content, orthe first user engaging with a second device or the first user lookingaway from the media device playing the first content for an extendedperiod; and in response to the identifying the user action thatindicates disengagement from the playing of the first content after thesecond user enters the proximity of the media device, modifying thestored relationship status that tracks the relationship between thefirst user and the second user.
 8. The method of claim 1, wherein thereceiving the command that controls playing the first content, after thesecond user entering the proximity of the media device, comprisesreceiving the command that controls playing the first content within athreshold time period of the second user entering the proximity of themedia device.
 9. The method of claim 1, wherein the detecting the seconduser entering the proximity of the media device playing the firstcontent comprises one or more of determining a location of a mobiledevice associated with the respective user, performing a camera scanusing facial recognition, listening to a voice using voice recognition.10. The method of claim 1, further comprises: detecting an additionaluser entering the proximity of the media device; identifying the commandthat controls playing the first content performed by the first user inresponse to the additional user entering the proximity of the mediadevice; and in response to the identifying the command that controls theplaying the first content after the additional user enters the proximityof the media device, modifying a stored relationship status that tracksthe relationship between the first user, the second user and theadditional user.
 11. A system comprising detection circuitry configuredto: detect a first user in the proximity of a media device playing afirst content; detect a second user entering the proximity of the mediadevice playing the first content; control circuitry configured to:receive, via the control circuitry, a command that controls playing thefirst content, after the second user entering the proximity of the mediadevice; in response to the received command that controls the playingthe first content after the second user enters the proximity of themedia device, modify, via the control circuitry, a stored relationshipstatus that tracks a relationship between the first user and the seconduser; detect, with the detection circuitry, the first user and thesecond user in the proximity of the media device playing a secondcontent; in response to the detecting the first user and the second userin the proximity of the media device playing the second content, performautomatically, via the control circuitry, an action that controls theplaying of the second content, wherein the action is selected based onthe stored relationship status that tracks the relationship between thefirst user and the second user; determine a third user with a similarrelationship with the first user as the second user entering theproximity of the media device playing the first content; identify apattern in the stored relationship status between the first user and thesecond user based on the receiving the command that controls playing thefirst content between the first user and the second user; modify astored relationship status that tracks the relationship between thefirst user and the third user based on the receiving the command thatcontrols playing the first content between the first user and the seconduser; detect the first user and the third user in the proximity of themedia device playing the first content; and in response to the detectingthe first user and the third user in the proximity of the media deviceplaying the first content, automatically perform the command thatcontrols the playing of the second content, wherein the command isselected based on the stored relationship status that tracks therelationship between the first user and the third user.
 12. The systemof claim 11, wherein when performing the action that controls theplaying of the second content, the control circuitry is furtherconfigured to perform the command that controls playing the firstcontent.
 13. The system of claim 12, wherein the control circuitry isfurther configured to not perform the action that controls the playingof the second content when just one user of the first user and thesecond user is in the proximity of the media device, but is performedwhen both users of the first user and the second user are detected inthe proximity of the media device.
 14. The system of claim 11, whereinwhen performing the action that controls the playing of the secondcontent, the control circuitry is further configured to perform theaction without receiving the command from the first user to perform thecommand.
 15. The system of claim 11, wherein when modifying the storedrelationship status between the first user and the second user thecontrol circuitry is further configured to: retrieve an existingrelationship data between the first user and the second user based on afirst user profile associated with the first user and a second userprofile associated with the second user; identify a type of a sociallink between the first user and the second user based on the respectiveuser profile, wherein the type of the social link comprises one or moreof a parent, a sibling, a grandparent, a cousin, an uncle, an aunt, achild, a friend, and a coworker; identify an age difference between thefirst user and the second user based on the respective user profile; andin response to identifying the type of the social link and the agedifference, modify the existing relationship data based on the type ofthe social link and the action that controls playing the first content.16. The system of claim 11, wherein the action that controls playing thesecond content comprises one or more of muting a volume of the mediadevice playing the first content, lowering volume of the media deviceplaying the first content, changing a channel of the media deviceplaying the first content.
 17. The system of claim 11, wherein thecontrol circuitry is further configured to: identify a user action thatindicates disengagement from the playing of the first content, whereinthe user action that indicates disengagement from the playing of thefirst content comprises one or more of the first user leaving theproximity of the media device playing the first content, or the firstuser engaging with a second device or the first user looking away fromthe media device playing the first content for an extended period; andin response to the identifying the user action that indicatesdisengagement from the playing of the first content after the seconduser enters the proximity of the media device, modify the storedrelationship status that tracks the relationship between the first userand the second user.
 18. The system of claim 11, wherein when thereceiving the command that controls playing the first content, after thesecond user entering the proximity of the media device, wherein thecontrol circuitry is further configured to receive the command thatcontrols playing the first content within a threshold time period of thesecond user entering the proximity of the media device.
 19. The systemof claim 11, wherein when the receiving the command that controlsplaying the first content, after the second user entering the proximityof the media device, wherein the control circuitry is further configuredto receive the command that controls playing the first content within athreshold time period of the second user entering the proximity of themedia device.